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CODE SPECTRUM AND RELIABILITY FUNCTION: 
^ ; GAUSSIAN CHANNEL 111 

O . 

A new approach for upper bounding the channel reliability function using 
the code spectrum is described. It allows to treat both low and high rate cases 
in a unified way. In particular, the earlier known upper bounds are improved, 
' and a new derivation of the sphere-packing bound is presented. 
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§ 1. Introduction and main results 

We consider the discrete time channel with independent additive Gaussian noise, i.e. if 
x = (#!,..., x n ) is the input codeword then the received block y = (yi, . . . , y n ) is 



> 

00 . y i = Xi +i 

where (£l, . . . , £„) are independent Gaussian r.v.'s with E£j = , E£? = 1. 

' n 

For x,y E M n denote (x, y) = J^Xiyi, \\x\\ 2 = (x,x), d(x,y) = \\x — y\\ 2 and 

i=i 

S' n ~ 1 (6) = {x E R n : \\x\\ = b}. We assume that all codewords x satisfy the condition 
||x|| 2 = An, where A > is a given constant. A subset C = {xi, . . . , xm } C S' n ~ 1 (v / An), 
M = e Rn , is called a (R, A, n)-code of rate R and length n. The minimum distance of the 
code C is d{C) = min{d(xi, Xj) : i ^ j}. 

The channel reliability function [H [2] is defined as 

E{R ' A) = '7™ pl n ]ll P,(R,A,n) ' 

where P e (R, A, n) is the minimal possible decoding error probability for a (R, A, n)-code. 

After the fundamental results of the paper [T], further improvements of various bounds 
for E(R, A) have been obtained in [2-9]. In particular, on the exact form of the function 
E(R, A) it was known only that [T] 

E(0,A) = j, E(R,A) = E sp (R,A), R clit (A) < R < C(A) , (1) 



J The research described in this publication was made possible in part by the Russian Fund for 
Fundamental Research (project number 06-01-00226). 
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where 




(2) 




(3) 



g(R, A) = ~ (yiQ. - e~™) + y/A(l - e~ 2 «) + 4) . 



Moreover, recently [8J the exact form of E(R, A) for a new region R%{A) < R < R cr i t (A) 
was claimed under some restriction on A. Similar to the case of the binary symmetric 
channel (BSC), that assertion follows from a useful observation that the tangent (it has 
the slope (—1)) to the function E sp (R, A) at the point R = R cr i t (A) touches the previously 
known upper bound for E(R,A) [5-7]. Since those results from [5-7] were proved under 
some restrictions on A, those restrictions were remaining in [8] as well. Since there are 
some inaccuracies in the formulation of that result in [8] we do not expose corresponding 
formulas from [8] (moreover, they have a different from ours form). 

From theorem 1 and the formula ([2j) (see below) the exact form of E(R, A) follows 
for the region ~R~i{A) < R < R CI it{A) for any A > 0. Moreover, if A > A « 2.288 (see 
(P3J) then from theorem 2 below the exact form of E(R,A) follows for a wider region 
Rs(A) < R < RcntjA), where R 3 (A) < R^A) and R 3 (A) « R cvit (A) - 0.06866, A > A . 

For < R < Ri(A), < A < A , or < R < R 3 (A), A > A , still only lower and 
upper bounds for E(R,A) are known [1-9], and in this paper the most accurate of the 
upper bounds is improved. 

We begin by explaining what constituted the difficulty in upper bounding the function 
E(R, A) in the earlier papers [5-9]. Note that when testing only two codewords Xi, Xj with 
large distance \\xi — Xj\\ 2 = d we have the decoding error probability P e ~ e~ d ^ 8 . Let B pn be 
the average number of each codeword Xi neighbors on the approximate distance 2A{1 — p)n. 
It was shown in [5] that for a (R, A, n)-code there exists p such that > 2 6 ^ n , where the 
function b(p) > is described below, and 2A(1 — p)n does not exceed the best upper bound 
(linear programming) for the minimal code distance d(C). Therefore, if each codeword Xi 
has approximately B pn neighbors on the distance 2A{1 — p)n, then it is natural to expect 
that P e > _Bp n e~ A ^~ p ^ n / 4 for large n (and not very small p), i.e. a variant of an additive 
lower bound for the probability of the union of events holds. 

The first variant of such additive bound was obtained in [5] under rather severe 
constraints on R and A. Those results of [5] have been strengthened in 0, [7], using the 
method of [10-12]. However there were still certain constraints on R and A. It should 
be noted that the investigation of E(R, A) for the Gaussian channel is similar to the 
investigation of E(R, A) for the BSC. The difference is only that due to the discrete 
structure of a binary alphabet some expressions become simpler. For the BSC the method 
of [6] was recently [14], [15] further developed. Although the approach of [14], [15] is still based 
on [6], some additional arguments allowed the approach to be essentially strengthened and 
simplified. 
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It should also be noted that until the papers [HI [15], all papers mentioned made use 
of various variants of the second order Bonferroni inequalities. 

The main aim of this paper is to prove an additive bound without any constraints on 
R or A. For that purpose the method of [HI C[5] is applied. It is also worth noting that 
Bonferroni inequalities are not used. This approach allows us to treat both low and high 
rate R cases in a unified way. As an example, in § 2 a new derivation of the sphere-packing 
bound is presented. 

Introduce some notations. For a code C = {x\, . . . , Xm} C S ,n_1 (V An) denote 

Pij = ' dij = \\xi - xA\ 2 = 2An(l - p i:j ) . (4) 

Below it will be convenient to use the parametric representation of the transmission rate 
R = R(t) via the monotonic increasing function 

R(t) = (1 + t)ln(l +t) -tint, t>0. (5) 
Consequently, for a rate R > introduce t R > as the unique root of the equation 

R = R(t R ) = (1 + t R ) ln(l + t R ) - t R \nt R . (6) 
Introduce also the functions 

2y/t(l + t) 

nt) = 1 + 2t , t r = nt R ) ■ (v 

We shall need the values 

h(A) = — a , ri(A) = r(ti(A)) 



2 + VITAl ' (8) 
R X {A) = RfaiA)) , 

where the functions r(t),R(t) are defined in flJJ) and (J6j) . Sometimes below we shall omit 
the argument A in t\(A),T\{A),R\{A). 
One of the main results of the paper is 

Theorem 1. For any A > the following relations hold: 

W( p A\ — I -^sp(-Rcrit, A) + -R cr it — R , R\ < R < -R C rit j /q\ 

* W - 1 A) ^ ^ < ^ < c ; w 

and 

£(it!, A) < A(yl ~ ^ + ln(l + 2t fl ) - it! , 0<R<Ri, (10) 

where R CT it(A), Ri(A), t r andt R are defined in (J2J), ©, «^g? ©, respectively. 

Remark 1. We have < ^^(A) , A > 0. Moreover, max {R crit (A) -R^A)} ta 

0.06866, and it is attained for A = A « 2.288. 
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Remark 2. Note that (see the formulas and (TTOl) for R= R\) 

E sp {R crit , A) + R crit = A(1 ~ Tl) + ln(l + 2tx) . (11) 
Validity of (PTTT) can be checked using the formulas (JTJ) and the relations 



, A 1,1 
l + 2ti = a/ — , E^t^-ln 



4Tl 2 1 — Ti 



A (l - e- 2 ^") = Ari = — - 4 , - 



;i2) 



ri JV 2^ 

If A > y4 ~ 2.288 (see (TT4l) ) then the upper bound (JTOj) can be slightly improved, and, 
moreover, the validity region of the first of formulas ([9]) can be enlarged to _R 3 < R < R CT a, 
where Rs(A) < Ri(A) (see (fl4l)). To explain the possibility of such an improvement consider 
the problem of upper bounding the minimal code distance 5(R, n) of a spherical code. The 
best upper bound for 5(R, n) was obtained in [4] using the linear programming bound. 
It was also noticed in [H p. 20] that for R > 0.234 a better upper bound for S(R,n) is 
obtained if the linear programming bound is applied not directly to the original spherical 
code, but to its subcode on a spherical cap. That observation was recently used in [9] when 
estimating the code spectrum and the function E(R, A). Using the approach of [6] an upper 
bound for E(R, A) was obtained in [9]. But it is rather difficult to use that upper bound 
since it is expressed as an optimization problem over four parameters. In fact, it is possible 
to get a more accurate and rather simple bound that constitutes theorem 2 below. 

Introduce the function 

D(t)=\n^— ; 1 — , t>0, (13) 

KJ t 2^t{l+T) 1 + 2*' {l6 > 

and denote t 2 ~ 0.061176 the unique root of the equation D(t) = 0. The equivalent equation 
(with a sign misprint) appeared earlier in [H p. 20]. Denote also 

R 2 = R(t 2 ) « 0.2339 , r 2 = r(* 2 ) « 0.4540 , 
R 3 (A) = R CTit (A) + R2 + I ln(l - r 2 ) « R crit (A) - 0.0687 , (14) 
A = min [A : Rx(A) >R 2 }~ 2.288 . 
The next result strengthens theorem 1 when A > A . 
Theorem 2. If A > A ^ 2.288 then the following relations hold: 

T?( Z? A\ — J E sp (R C Tit, A) + -R cr it — R , R3 < R < -Rcrit j r\ 

E{R,A) - I Esp(R,A) , R crit <R<C, (15) 



and 




< R < R 2 , 

E(R,A)<{ f 1 ' J _ _ (16) 

^ ' " " ^lna, R 2 < R < R;j(A) , 
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where a = (1 - r 2 )e 2i?2 « 0.8717. 

For a comparison purpose we present also the best known lower bound for the function 
E(R, A) [1;3, Theorem 7.4.4] 

( A (1 - VI - e- 2 «) /4, 0<i?<i? low , 
E(_R, A) > < E sp (R CTit , A) + i? crit — i? , i? low < R < -R cr it, (17) 
[ E sp (R,A), R CTit <R<C(A), 

where 

^ / ^ 1,2 + vM 2 + 4 , . 

R bm {A) = -]n — 4 . (18) 

Combining analytical and numerical methods it can be shown that for A > A we have 

R low {A) <R 2 < R 3 (A) < R^A) < R crit (A) . (19) 

On the figure the plots of upper (TTSl) . (fT6l) and lower (fT7l) bounds for E(R, A) with A = 4 
are presented. 

The paper is organized as follows. In §2 the main analytical tool (proposition 1) is 
presented and, as an example, the sphere-packing upper bound is derived. In §3 proposition 

1 and the code spectrum are combined in propositions 2-3. In §4 (using results of §3 and 
the known bound for the code spectrum - theorem 3) theorem 1 is proved. In §5 theorem 

2 is proved. Proofs of some auxiliary results are presented in Appendix. 

§ 2. New approach and sphere-packing exponent 

For the conditional output probability distribution density p(y\x) of the input codeword 
x the formula holds 

lnp{y\x) = -- d(y, x) - - ln(27r) , x, y G W 1 

(in a similar formula in [6] there is a misprint - the minus sign is missing) . To describe our 
approach, we fix a small 5 = o(l), n — > oo, and s > and for an output y define the set: 

X.{y) = { Xi eC: \d(y, x t ) - sn\ < 5n} , ye W n . (20) 

All codewords {xi} are assumed equiprobable. For a chosen decoding method denote 
P(e\y,Xi) the conditional decoding error probability provided that x^ was transmitted 
and y was received. Denote p e (y) the probability distribution density to get the output y 
and to make a decoding error. Then 

M 

p e (y) = M- 1 Y,P(y\xi)P(e\y, Xi ) > ikT 1 P(v\ x i) p ( e \v> x i) = 

= M~\2n)- n / 2 Yl e- d (y> x ^ 2 P(e\y, Xi ) > 

> M-\2ire s+8 y n / 2 ^ P{e\y,Xi) > M-\2^e s+8 )- n l 2 [\X 8 {y)\ - 1] + , 
Xi&X a (y) 



where [z} + = max{0,2:} and \A\ - the cardinality of the set A . For the decoding error 
probability P e we get 

P c = J Pc {y)dy>M-\2'Ke s+6 r n ' 2 j [\X s {y)\ - 1] dy . 
y m " y-.\X s (y)\>2 
Since (a — 1) > a/2, a > 2, we have 



P c > (2M)- 1 (2ne s+5 )- n/2 J \X s (y)\dy. 



(21} 



J/:|X s (t/)|>2 



where X s (y) is defined in f |20l) . To develop further the right-hand side of ( l2~Pj ) we fix some 
r > and for each Xi introduce the set 

z 8 ,r(i) = {y : \\\y\\ 2 ~ rn \ - <^> \d(y> x t) - sn \ < <fo> \x s {y)\ > 2} = 

I \\y\\ 2 — rn\ < 5n , \d(y, xi) — sn\ < 5n and 1 (22) 
there exists Xj ^ x^ with |d(a?j, y) — sn\ < 5n J ' 

For a measurable set A CR" denote by m(A) its Lebesque measure. Then 

M 



y ■ 



j \X s {y)\ dy>J2™( Z s,r(i)) 



y.\X s (y)\>2 
and from (l2P|) we get 

Proposition 1. VF^/i any 5 > /or £ne decoding error probability P e the lower 
bound holds 

Pe ~ m max|(2vre^)-"/ 2 gm(Z Sir «)| , (23) 

where Z s ^ r (i) is defined in (|22l) . 

Example: sphere-packing upper bound. We show first how to get the sphere- 
packing upper bound E(R,A) < E sp (R,A) from ( 1231 ) (cf. [1;3, Chapter 7.4]). To simplify 
formulas we write below a ~ b if |a — b\ < 5, where 5 = o(l), n — >■ oo. Note that 

Z s>r (i) = Z#(i) \ Zg(z) , = {y : ||y|| 2 /n « r, dfo/,!*)/" « s} , 

Zf)(i) = {y: \\y\\ 2 /nnr, d(y, Xl )/n^s, \X s (y)\ = l} = 
= {y : ||y|| 2 /n « r , d(y, Xi)/n ~ s and there is no £Cj 7^ #1 with d(£Ej, y)/n ~ s } . 
Then we have 

M 

|JZW(<) = y s = {y : ||y||7n « r, |X.(y)| = 1} = 



i=i 



{y : ||y|| 2 /n « r and there exists exactly one cc, with d(y, Xj)/n ~ s } 
y s C V(r) = {y : ||?/|| 2 /^ ~ r} , 



and the lower bound (l23l) takes the form 



P e > (2M)- 1 {27ce s+5 )- n/2 Mm (|Z^(1)|) -m(Y(r)) 



The surface area of a n-dimensional sphere of radius a is S n (a) = nix n l 2 a n 1 /T{n/2 + 1) 
(2irea 2 jn) n ^ . Then from a standard geometry we get 



rn 



(|Z«(1)|) ~ (27rer 1 )"/ 2 , m {Y{r)) ~ (2vrer) n / 2 

(r-A-sf (r + A-s) 2 

ri — s — = r — 



AA 



AA 



Therefore the lower bound (l23l ) takes the form 

P c > M- 1 (e» +i - 1 )- ft / 2 [Mrf - r n / 2 



(24) 



We want to maximize the right-hand side of ( |24l ) over s, r. Since we are interested only 
in exponents in n, we may assume that Mr^ 2 = W 2 , i.e. e 2R r\ = r. Then we should 
maximize the function f(s, r) = lnr — s provided 



(r - A - s) 2 
S 4A 

As usual, considering the function 

g(s, r) = lnr — s + A s — 

and solving the equations g' s = g' r = 0, we get 

1 



— re 



-2R 



(r - A - s) 
AA 



re 



-2R 



s = r + A — 



2A 



l-\(l-e- 2R ) ' A 
where A satisfies the equation 

(l-e- 2R ) X 2 + A(l-e- 2R )X-A = 0. 

Therefore 

A = 



.4 



gWl - er 



2R 



where g\ = gi(R,A) is defined in ((3l). Note that 



g 2 -l=g ^A (1 - e-**) , 1 - A (l - e- 2R ) = \ 
\nr - s = 2\ng - 1 - A + g y/A(l - e~ 2R ) . 



Taking into account that e 2R ri = r, we get from (IMj) and p]) 

1 1 s-1 , s-1 „ 1 

— in — < in ri = h it in r = 

n P e ~ 2 2 2 

A - J A (1 - e- 2R )g(R, A) , , 

= v \ _ m ) _ ln g ^ A) + R = Esp{R ^ A) 

which gives the sphere-packing upper bound E(R,A) < E sp (R,A). 

§ 3. Lower bound (1231) and code spectrum 

For a code C C S , " -1 (V An) introduce the code spectrum function 



B{s,t) = W\ 



u,v EC : s< < t 

~ An 



(25) 



and denote 

b(p, e) — — In B(p — e,p + e) , < e < p . 
n 

To simplify notation we write below a « b if \a — b\ < 5, where 5 = l/V An. For some 
r > we consider only the set of outputs 

Y(r) = {y : \\y\\ 2 /n « r} C M n . (26) 

To investigate the function A), i? < -R C rit, we use a variant of the lower bound 

P c > (2M)- 1 maxmax \ (2vre s+<5 )- n/2 V m (Z, P (p, i)) \ , (27) 

\ i=l J 

where 

„ / . \ f v there exists x~ with pj,- ~ p and 1 

and Pjj is defined in (jl]). We develop the lower bound (1271) . relating it to the code spectrum 
(l25l) . i.e. to the distribution of the pairwise inner products {pij}. 
For codewords cCj, cCj with p^ ~ p introduce the set 

Z s>r (p,i,j) = {y eY(r) : d(xi,y)/n & d(xj,y)/7i& s } . (29) 

Then for any i from ( |28l) and (1291) we have 

Zs,r(j>,i)= IJ Z s>r (p,i,j). (30) 

Denoting 

Z(s,r,p) = m(Z Sjr (p,i,j)) (31) 
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(since the measure of that set does not depend on indices we have (see Appendix) 

— \n.Z(s,r,p) = -ln[2irez(s,r,p)]+o(l), n — > oo , (32) 
n 2 

where 

(A + r-s) 2 . . 

z(s,r, P ) = r- 2A{i + p) . (33) 

Note that due to (1301 ). for the sum in the right-hand side of (1271 ) for any p we have 

A/ 

^m(Z s>r (p,z)) < rn(Z Sjr (p,i, j)) = Z(s,r,p) j) : p i5 » p}| = 

i=l (i,j)-Pij~P (34) 

= exp j ^ In [27rez(s, r, p)] + [i? + &(p)]n + o(n) | , 
since for b(p) = b(p, 5) the following formula holds (see (125]) ) 

|{(U) = P« « P}\ = e Rn B(p -6,p + 6) = e( R+b ^ n . 
Suppose that for some p = po in the relation ( 1341) the following asymptotic equality holds: 



-In 

n 



M 



^2m(Z SiT (p 0l i)) 



i=l 



-In [2nez(s,r, p )] + R + b(p ) + o(l) , n — > oo . (35) 



Using the functions s = s(p), r = r(p) (they are chosen below), from (1271) . (l35l) and 
(l33j) for such p we get 



11 s - 1 1, 
— In — < In 

n P~ 2 2 



(A + r-s 

r - 



2A{l + Po ) 



-6(po) + o(l). (36) 



We set below 

»(P) = ^ + 1, r W = ^ + l. (37) 

Such choice of s(p),r(p) minimizes (over s, r) the right-hand side of (l36l) . Optimality of 
such s, r can also be deduced from the formulas (1721) (see Appendix). 

For such s(p), r(p) we have r — (A + r — s) 2 /[2A(l + p)] = 1, and then (l36l) takes the 
simple form 

I In 1< ^1^-6(^+0(1). (38) 
n P e 4 

Note that 6(p) > if there exists a pair (xi,Xj) with Pi j ~ p, and b(p) = — oo if there is 
no any pair with py p. 

We formulate the result obtained as follows. 

Proposition 2. If for some po the condition ( 1351 ) is fulfilled, then the inequality 
(l38l) /or i/ie decoding error probability P e holds. 
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We show that as such po we may choose the value po, minimizing the right-hand side 
of ([38]) . In other words, define po as follows 

Ap + Ab(po) = max {Ap + Ab(p)} . ( 39 ) 

Remark 3. If there are several such p , we may use any of them. It is not important 
that we do not know the function b(p). We may use as b(p) any lower bound for it (see 
proofs of theorems 1 and 2). 

Proposition 3. For po from (1391) the condition ( 1351 ) holds and therefore the 
inequality (|38l) is valid. 

P r o o f. It is convenient to "quantize" the range of possible values of the normalized 
inner products pij. For that purpose we partition the whole range [—1; 1] of values p^- on 
subintervals of the length 6 = 1/V An. There will be ri\ = 2/5 of such subintervals. We 
may assume that p^ takes values from the set {— 1 = p\ < . . . < p ni = 1}. 

We call (xi,Xj) a p-pair if (ccj, Xj)/(An) « p. Then Me nb ^ is the total number of 
p-pairs. We use s = s(po),r = r(p ) from (1371 ) and consider only outputs y G Y{r) = 
Y(r(po)). We say that such a point y is p-covered if there exists a p-pair (xi,Xj) such 
that d(xi,y)/n ~ d(xj,y)/n ~ s. Then the total (taking into account the covering 
multiplicities) Lebesque measure of all p-covered points y equals Me nb ^Z(s,r,p). 
Introduce the set Y(p , p) of all p-covered points y 

^(Po ; p) = {y ^ Y(r) : y is p— covered} . 

We consider the set Y(p , p) and perform its "cleaning", excluding from it all points y that 
are also p-covered for any p such that |p — po| > 45, i.e. we consider the set 

Y'(p ,p ) = Y( Po ,p )\ |J Y( Po ,p) = 

\ P - P0 \>*s (4Q) 

Y( \ y * s Po~ covere d and is not p— covered 
^ ' for any p such that |p — p | > 45 

Each point y G Y'(p , p ) can be p-covered only if |p — p | < 45. We show that both sets 
l^(po,po) and l^(po,po) have essentially the same Lebesque measures. Note that a p-pair 
(xj,, Xj) p-covers the set Z s r (p,i,j) from l{29|) with the Lebesque measure Z(s,r,p). We 
compare the values Yl e nb ^Z(s, r, p) and e nb( - Po ^Z(s, r, p ) (see (T4D1 ). For that purpose 

we consider the function 

1 e nb ^Z(s,r,p) ,1, z(s,r,p) 
g(p) = - In = 6(p) - 6 po + - In — + o 1 , 41 

e n6 ^°- , z(s, r, po) 2 z(s, r, p ) 

where z(s,r, p) is defined in (|33l) . From f|33l) we also have 

z(s r p ) = i + ^(i + poKp-pq) 

z{s,r,p) l+ 2(i + ^ 
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Since b(p) < b(po) — A(p — po)/4 (see (l39l) ). for the function g(p) from (l4Tj) we get 



/ N 1 1 

9{P) < 2 ln 



A(l + p )(p-po) 
2(1 + p) 



A(p - po) < A(p - po) 2 2 



4 - 4(1 +p) 
Since p — p = i5 , \i\ > 4, after simple calculations we have 

e nb ^Z(s,r,p) 

= V e^<2Vexp(-^l=2V e ^<l 

e nb ^Z(s,r,p ) ~ P\ 8 J Z. 2 

Therefore we get 

e^Z(s, r, po) - £ e*'Z( S) r, p) > l - e nb ^Z(s, r, p ) . 

|p-po|>4<5 

Then the total (taking into account the covering multiplicities) Lebesque measure of all 
p-covered points y G l^'(p ,po) exceeds Me n6 ' P0 'Z(s, r, po)/2. Remind that any point t/ G 
Y'(po,po) can be p-covered only if |p — po| < 45. 

For each point 2/ G l^'(po,po) consider the set X s {y) defined in ( l20l) . i.e. the set of 
all codewords {x^ such that d(xi,y)/n rs s. The codewords from X s (y) satisfy also the 
condition |(a3j,a;j) /(An) — p | < 45, i.e. the set {x^ constitutes almost a simplex. It is 
rather clear that the number |X S (?/)| of such codewords is not exponential on n, i.e. 

max { — ln |X s (y)| > = o(l) , n — > oo . (43) 



yeY'(p , P0 ) 



n 



Formally the validity of (1431 ) follows from lemma 2 (see below). 

Note that if Ai, . . . , Cl" are a measurable sets, and any point a G |J Ai is covered 

i 

by the sets {A^} not more than K times, then 

/N \ N 

^=1 / 1=1 



For y G "K'(po,Po) denote 



Xi(i/) = {xj : d(xi, y)/n « dfo, y)/n « s, p - « p } , 

X max = max \Xi{y)\. ( 4 5) 



Due to (SHI) we have 



- ln X max = o(l) , n -> oo . (46) 
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Since any point y G Y (po, po) can be p-covered not more than A max times and Y'(po, po) C 
Y(po,po), then from (13H|l ^ (l3Hjl we get 



iln 

n 



M 



i=l 



> -\nm(Y'(p ,p )) > 
n 



> - In (Me nb(po) Z(s, r, p )) + oil) = ^ 
n v 

= - In [2irez(s, r, p )] + R + b(p ) + o(l) , n — >• oo . 

Therefore due to the inequalities (1341) and fT47l) . the condition (l35l) is fulfilled, and then the 
relation ( 15511 holds. 

To complete the proof of proposition 2 it remains to establish the formula ( 1451) . We 
prove it first for a simpler (but a more natural) case p* < T\, and then consider the general 
case. 

Case po < f\. In that case the relation (1451) follows from simple lemma (see proof in 
Appendix). 

Lemma 1. Let j/el™ with \\y\\ 2 = rn. Let C = {xx, . . . , x M } C 5 n_1 (\/An) 6e a 
code with \\xi — y || 2 = sn, z = 1, . . . , M , and max(a;j, Xj) < Anp. If 



A + r - s>2^/~Arp , (48) 

then M < 2n. 

For s(p),r(p) from (1571) the condition ( 1451 ) holds, if 

p< = tiM) . (49) 

From lemma 1 and (T49l the relation (T43l) follows. 

General case. Although a code with p > f\ can hardly decrease the decoding 
error probability P e , its investigation needs a bit more efforts. The relation (1451) follows 
from lemma (see proof in Appendix). 

Lemma 2. Let for a code C = {xi, . . . , Xm} C S n ~ 1 (VAn) and some p < 1 it holds 
that 

max \(xi, Xj) — Apn\ = o(n), n — > oo . 

T/ien InM = o(n), n — >• oo. 

It completes the proof of proposition 3. A 

Using proposition 3 and two lower bounds for b(p) we shall prove theorems 1 and 2. 

S 4. Proof of theorem 1 
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First we investigate the function E(R, A) for < R < Ri(A) and prove the upper bound 
(fTOl) . Then for Ri(A) < R < R crit (A), using the "straight-line bound" [2], we will prove the 
formula ((9]). To apply proposition 3 we use the known bound for the code spectrum. The 
next result is a slight refinement of [S, Theorem 9] (see also [6] Theorem 1]). 

Theorem 3. Let C C S' n_1 (v / An) be a code with \C\ 
e = e(n) > there exists p such that p > tr and 



e Rn , R > 0. Then for any 



- lnB(p- e,p + e) > R- J(t R ,p) + — + o(l) , n 
n n 



b(p) — — in ].>[,'> - :. i> •- :) > ii - ■/(/;■•. p) -f •- <>([.). a — x 

J(t, p) = (1 + 2t) In [2tp + q(t, p)] - In q(t, p) - t ln[4t(l + t)} 



(50) 



q(t,p)=p+y/(l + 2ty P *-4t(l+t), 
where tn, Tr are defined in (J4]) and ((7]), and o(l) does not depend on e. 



Note that 



J' P (t,p) 



4t(l + t) 



P + + 2t) V - 4t(l + t) 



4t(l + t) 



[p + v /(l + 2t)V-4t(l+t)] 1 



;i + 2t) 2 P 



V(l + 2t) 2 p 2 - 4t(l + t) 



(51) 



J#, p) = 2 In [2tp + g(t, p)] - ln[4t(l + t)} , 
[R(t) - J(t, p)]' t = 2 In 2(1 + t) > , J(t R , t r ) = ln(l + 2t fl ) , J(t fl , 1)=R. 

ZZp "T 0/ 

Proposition 4. For £/«e function E(R } A) the upper bound (TTOl) holds. 

Proof. Due to theorem 2 there exists p > tr such that the inequality (1501 ) holds. 
Denote p* the largest of such p. Since 6(p ) > 6(p*) - A(p - p*)/4 (cm. (El)), from (EHJ) 
and (l50l) we get 



(52) 



1,1 A(l-pn) s . . A(l-p*) 

- In - < 1 4 W - 6(p ) + < 1 4 ^ - + < 

< A(1 ~^ ) +Jfa,p*)-i* + o(l). 

Note that if r R < T\ (i.e. if R < Ri(A)) then (see Appendix) 

[J(tR,p)-Ap/A]'<0, p>T R , 



(53) 



and therefore the function J(t R ,p) — Ap/4 monotone decreases on p > t r . Since p* > r R 
then for < f\ we can continue ( l52l) as follows 



(54) 



I i n _L < A(1 Tfi) + j(t R} Tr)-R + 0(1) 
n P e 4 



A(l - Tr) 



+ \n(l + 2t R )-R. 
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< i? < i?i 



which is the desired upper bound (fTOl) . ▲ 

To prove the relation j9]) note that the best upper bound for E(R, A) is a combination 
of the upper bound ( fTOl ) and the sphere-packing bound via the "straight-line bound" [2], 
which gives 

E{R, A) < A(yl ~ Tl ^ + ln(l + 2ti) -R, Ri < R < R ait ■ 

On the other hand, the random coding bound [U [3] gives 

E(R, A) > E sp (R CT i t , A) + R crit — R , R < R CTit , 

where E sp (R, A) is defined in (J3j) . Together with the formula ([Til it completes the proof of 
theorem 1. A 

§ 5. Proof of theorem 2 

As was already mentioned in §1, for R > 0.234 the upper bounds for the minimal 
code distance [4j, p. 20] of a spherical code and its spectrum [9j can be improved, if the 
linear programming bound is not directly applied to the original spherical code, but to its 
subcodes on spherical caps. The same approach allows to improve the upper bound for 
E(R, A) as well. For that purpose we will need a bound for a code spectrum better than 
( 1501) . The bound obtained below (theorem 4), probably, is equivalent to the similar bound 
in [9l Theorem 3] (expressed in a different terms), but its derivation is simpler and a more 
accurate. 

Since we are interested only in angles between codewords x^Xj, for the formulas 
simplification we may set An = 1, and consider a code C C S n ^ 1 (l) = S 12 ^ 1 . Let Tq(z) be 
the spherical cap with half-angle < 6 < n/2 and center z G S 71 ^ 1 , i.e. 

T£{z) = {xe S 11 - 1 : (x,z) > cos6} . 

It will be convenient to consider subcodes of C not on spherical caps Tg(z), but on related 
with them thin ring-shaped surfaces Dg(z). We set further S = l/n 2 , and denote Dg(z) as 

D$(z) = T%{z)\T$_ s {z) = {xe S' 1 - 1 :cos6< (x,z) < cos(# -5)}. (55) 

Denote D n (9) the surface area of D^{z). Then (Tj, formula (21)] 

e 

( n — i W(«-i)/2 r 

DJ9) = K 77 J w x / sm n - 2 udu, 5<9<n/2. 
nK } r((n+l)/2) J ~ ~ 1 

6-5 

It is not difficult to show that 

! 1 < D B (g)r((n + l)/2)n 2 

2nsin^ ~ tt^ 1 )/ 2 ^ - 1) sin"" 2 ^ ~ 
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Since the surface area \S n 1 1 of the sphere S n 1 equals n7r n / 2 /T(n/2 + l), we have uniformly 
over 1/n < 9 < ir/2 

1, DnjO) , • ^ m 

— in — — — = m sin 9 + o( 1 ) , n — > oo . 

n l^™- 1 ! v ' 

For the code C C S*"" 1 and 6 1 such that max{arcsine _i? , 1/n} < 9 < 7r/2, and z G S' n_1 
we consider the subcode C(9, z) = C fl Dg(z) with |C(#, z)| = e" r ( z ) codewords. Then 

1 f xn,n ~M,~ l C l D »W 



/ |C(g,g)[dz= = exp{(# + lnsinfl)n + o(n)}, 

J \S n L \ 



m(S n - 1 

i.e. in average (over z G S" 1-1 ) a subcode C(9, z) has the rate r = i? + In sin # + o(l). All 
its |C(0,z)| codewords are located in the ball B n (sin9,z') of radius sin# and centered at 
z' = zcos9. Moreover, they are located in a thin (of thickness ~ 5) torus orthogonal to z. 
If x G Dq(z), then we denote x' = x — z' the corresponding vector from £> n (sin#, z'). The 
original angle ip between two vectors x, y G D$(z) becomes the angle ip' + 0(5) between 
the vectors x',y' G £? n (sin 9, z'), where sin(<///2) = sin(<p/2)/sin#. The original value 
p = cos <p becomes the value p' + 0(5), where p' = cos tp' is defined by the formula 

1 - p = (1 -p') S m 2 9, (56) 

since 

P V V sin # // sin 2 ^ V HJ 

The angle ip' and the value p' correspond to the case when the vectors x', y' are orthogonal 
to z. The code C(9, z) is then transferred to the code C'(z) = C'(9, z) C _B n (sin#, z'). 

To evaluate the average number e nbc ^ of p-neighbors in the code C, we consider any 
pair Xi, Xj with (Xi, Xj) = p and introduce the sets 

Z(x, a) = {ze S' 1 - 1 : (x, z) > a} , 
Z(x,y,a) = [z G S" 1-1 : (x,z) > a and (y,z) > a] . 

Denote by fl n (9) the surface area of the spherical cap Tg(z). For < 9 < n/2 we have 

(n-l)/2 s j n n-l Q 

Then for the Lebesque measure m(a) of the set ^(cc, a) we have 

m(a) = m (Z(x,a)) = f2 n (arccosa) . 
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We evaluate the Lebesque measure m(p, a) of the set Z(x, y, a) provided (x, y) = p. Note 
that if a?, y G S 11 ' 1 and (x, y) = p, then \\x + y\\ 2 = 2(1 + p). Therefore v = 
(x + y)/y/2{l + p) G S n ~\ and then 

Z(x, y, a) C {ze S' 1 - 1 :(x + y,z)> 2a] = 

= {ze S" 1 - 1 : (v, z) > ^2/(1 + p)} = Z (v, ay/2/(l + p)) . 

Therefore we get 

m(p, a) = m (Z(x, y, a)) <m{z (v, ay / 2/(l + p)JJ = f2 n (arccos ^0-^2/(1 + p)JJ . 

That upper bound for m(p, a) is logarithmically (as n — > oo) exact. In particular, if a = 
cos 6* and (cc, y) = p, then 

— In — — > In sin 9 — In sin ( arccos ( y 2/(1 + p) cos 

n m(p, cos 9) V V 



In sin #-lnv/l-2cos 2 fl/(l + p). 



We use below the values p' = p'(p,6) from and ( 1561) and e' = e/ sin 2 ^. Then denoting 
5 c (p) = B c (p -e,p + e), B C '{ Z ){p') = B c >( Z ){p' - e',p' + e'), for any p,e we have 

B ^ = M^¥) J ^(P')\C'(*)\dz- (57) 

zeS"- 1 

Indeed, the value B c (p)\C\ is the total number of pairs Xi, Xj G C with \(xi, Xj) — p\ < e, 
and Bc'(z){p')\C'(z)\ is the total number of similar pairs x'^x'a G C'(z) with \{x[, cc'-)/(||a4|| • 
ll^jll) _ p'| < e'- Moreover, each pair x' { , x'j G C'(z) gives the contribution m(p, cos #) to 
the integral, from which the formula (1571) follows. From ( 1571) for any set .A C S 71 ^ 1 we have 

e" bc(p) > — J e nb c'(Z)(p')\C'(z)\dz, (58) 



m(p, cos^)^! 

ze.4 



and also 



1^1 = ^ 7TV / \C'(z)\dz>^— - / |C'(*)|d*. 

m(costf) J m(cost') J 

zeS"- 1 ze.4 

The code C\z) has the rate r(z) = (In |C'(z)|)/n. Then there exists r such that 

o(n) p 7 "o n +°( n )rn(' I S'n N ) 

|C| = max {e'"m(z G S^ 1 : |r(«) - *| < e)} 



m(cos#) t m(cos9) (59) 

5 = {zG5 n - 1 :|r(z)-r |<£}. 



Since m(So) < m(S n *) then 



r >-ln ' ' \ n =R + \nsm9 + o 1 . 60 
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We set A = So and e = o(l), n — > oo. Then using the Jensen inequality, from (l58l) and 
(l59l) we have 

e «&c(p) > 1 / e nb c'(^)^')| C '( z )| rfz > 

m(p, cos 6)\C\ J 



Z&So 

> r (c °T'l fe^Uz> 

m (p, cos t))m{bo) J 
zeSo 

m(cos#)e o(n) I n /" , 

^ / ex P 1 — TcT / 6 c'(2)(p 

m(p, cos#) 7n(5 ) J 

I zes 



from which we get 

71 771 (p, COS 6*) 77l(5'o) 



j 7771 COS u ) I /* 

6c(p) >- In — ^ k + ^^T / &c(z)(p')^ + o(l). f 61 ) 

77 777(0. COSt^l 777 Dn / V ul / 



zes 

Due to theorem 3 for each code C'(z), z G So, there exists p" = p"(z) such that p" > r ro 
and 

6c(z)(p") >r - J(t ro ,p") + o(l). 
Therefore there exists p' > r ro and the corresponding p = p(p') from (l56l) such that from 
the inequality (16T1) we get 

, / \ 1 , 77l(cOs6!) * ,. 

6c P > - In ^ + r - J(t ro ,p ) + o(l) > 

| 777 ( COS u ) 

= -In— ^ £r + fl + lnsin0- J{t R+hlt6n0 ,f/) + o(l) > , 

77 777(p, COS0) (62) 

> i2 + 2 In sin 9 - J(t R+lnBhl0 , p') - In y/l - 2 cos 2 0/(1 + p) + o(l) = 
= R + lnsin6» - J{t R+ i nsine , p') + ^ In ^ + o(l) , 

where we used the formula f l60l ) and monotonicity of the function r — J(t r ,p) on r (see 
(l5T|) ). and p' = p'(p,9) is defined in (|56l) . After the variable change sm9 = e r ~ R from (162]) 
we get 

Theorem 4. Zet C C S' n ~ 1 (l) 6e a code with \C\ = e Rn , R > 0. TTien /or an?/ r < R 
there exists p' such that p' > r r and for p = 1 — (1 — p')e 2 ( r ~ R ' ifte following inequality holds 

b c (p) > r - J(t n p') + I In |i±^ + o(l) . (63) 

Using the relation (1631) in the inequality (l38l) we prove theorem 2. We have 

(64) 



11 ( A(l-p) , . . . 
— In — < minmax < o(p) > + o(l) < 

77 P e ~ r<R p>>rr I 4 1 



fA(l-p')e 2 ( r - /? ) T/ A 1 1+p'l . „ , 

< minmax < r + J L, p H — In > = minmax nr. p) 

-r<Hp'>r r \ 4 V 2 1 + pJ r<R p>r r ^ V ' HJ 

17 



where 



4 v r,rj 2 2e 2 ( R ~ r ) +p-l' 

With t = t r and (1 - r r )e 2 < r - R ^ = 2z we have 

_ _Ae 2 ^ R) _ 1 4t(l + 1) 1 



4 2(2e 2 («-'-) + p - 1) p+ v /(i + 2 t)V-4t(l + t) 2(1 + p) 
, _Ae^l 1 1 



4 2(2e 2 ( fi -'-) + r r - 1) 2(1 - r r ] 

Az 2 - (A + 2)z + 1 



2(1-2)(1 -T r 



Since < then p = r r is optimal if f' p \ p=T < 0. Since r < R then z < 1. Therefore 



f'p\ p - T — if the following inequalities are fulfilled: 



A + 2 + v^+4 

— 2 — ?n • ("^) 



A + 2 + V^ 2 + 4 ~ ~ "2A 

The right one of the inequalities (l65l) is always satisfied. The left one of the inequalities 
( |6ol) is equivalent to the inequality 



f 2 (r) =2r + ln(l - r r ) >2R- 2R cvit {A) . (66) 

The next simple technical lemma concerns the function f 2 (r) in the left-hand side of (IB"6l ). 

Lemma 3. The function f 2 {r) from ( 1661) monotone decreases on < r < i? 2 , and 
monotone increases on r > R 2 , where R 2 is defined in (fT4l ). Moreover, the formula holds 

ki{l-T 1 {A)) = -2R clit {A), A>0. (67) 



Since the function E(R,A), R > R\{A), is known exactly (see theorem 1), we consider 
only the case R < R\(A). Then two cases are possible: R < min{Ri(A),R 2 } and R 2 < 
R < ~R 1 (A). 

Case R < minji?!^), R 2 }. For R < R 2 minimum (over r < R) in the left-hand side 
of (l66l ) is attained when r = R, and then due to (l67j) the inequality ( l66l ) reduces to the 
condition tr < ri(A) 3 i.e. to R < Ri(A). Therefore if r < R < mm{Rx(A), R 2 } then the 
inequalities (1661 ) and (1651 ) are fulfilled, and then p = r r is optimal in the right-hand side of 
(EH). Since J(t r ,r r ) = ln(l + 2t r ) = -ln(l - r r 2 )/2 (see (ED) and ©), then (EH) takes the 
form 

-In— < min f(r,r r ) = min C(v(r)) - R, R < mmiR^A) ,R 2 } , (68) 

72 P e r<R r<R 
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where 

An 1 

COO = — " g ln K2 - «)] > y ( r ) = C 1 - ^)e 2(r " R) . (69) 

Note that for r = i? the inequality (l68l) reduces to the previous bound (IPOl) . We show that 
such r is optimal in (|68l) . We have 

4i;(2 - = -At; 2 + 2(A + 2)v - 4 , C£ > . 

Since < v < 1 , the equation C£ = has the unique root v\, where 

v x = 4 - = e - 2R ^ A) . (70) 

The function C(t>), < t> < 1, monotone decreases on < v < v\ and monotone increases 
on v > v\. Note that since v(r) = e^ 2 ^~ 2R , then (see lemma 3) the function v(r) monotone 
decreases on < r < R 2 and monotone increases on r > R 2 . 

If now R < mm{Ri(A), R 2 }, then v(r) > V\ for r < R. Therefore r = i? is optimal in 
(j68|l . and then (|68l) reduces to the previous bound (TTUT) . 

Case R 2 < R < Ri(A) (i.e. A >_j4<,). Then #2 < ^s(^) < Ri{A), where # 3 (A) is 
defined in (TT41) . Consider first the case R 2 < R < RsiA). It is simple to check that then the 
inequality (l66l) is again satisfied (see (fill) ). Therefore p = r r is optimal in the right-hand 
side of (l64L_and (l64l) takes the form (SSJ). Since i? < fl 3 (A), then v(r) > v x for r < R. 
Since R > R 2 then r = _R 2 is optimal in ( |68l ). and then from (1681) the second of bounds 
(El follows. _ _ 

1 1 remains to consider the case R 2 < R 3 (A) < R < Ri(A). Since minimum of C(v) over 
< v < 1 is attained for v — V\ (see (TfOl ). then 

min C(v) = C(v x ) = E sp (R crit , A) + R crit , ( 7 i) 

0<v<l v ) 

where the formula was used 

£s P (#crit, -4) + #crit = - Tjlnui - ~ ln(2 - Vi) . 

Now in the right-hand side of (1641 we set r such that u(r) = V\ (it is possible when R> R 3 ). 
Then again the inequality f|66l) is fulfilled and p = r r is optimal in the right-hand side of 
( 1541 . From ( 1681 ) and (1TT1) the first of upper bounds (1T51 follows. The upper bound ( 11511 
can also be proved applying the "straight-line bound" to the sphere-packing bound and the 
second of upper bounds (li~6l) at R = R 3 , and the formula 



A np ~2R 3 i _ i 

E sp (R crit , A) + R CTit -R 3 = ln(2 - ae~ 2R *) - - In a , 

which is simple to check using the relations (JT2l . It completes the proof of theorem 2. 
▲ 
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APPENDIX 

Proof of formula (l32l) . Without loss of generality we may assume that 
x i ,Xj,y have the form 

X { = (xi,X 2 ,0, . . . ,0), X j = (-X 1 ,X 2 ,0,...,0), V=(0,V2,V3,---,Vn), 

from which we have 

d(xi, Xj) = Ax\ = 2An(l - Pij ) , 

n 

d{xi, y)=x\ + (y 2 - x 2 f + J2yl 



sn . 

k=3 



x\ + x\ = An , Vk 
Solving those equations we get 



rn. 

k=2 



_ An(l- Pij ) _ An(l + PlJ ) _ (A + r-s)n 

Xl ~ Xl 2 ' X2 -V 2 ' V2 ~ ^(l + p,)' { ) 



and therefore 



from which the formula (1321 ) follows. ▲ 

Optimality of s(p),r(p) from the formulas (1371) also follows from ((72 



E2 2 (A + r- s) 2 n 
y h = rn — y 9 = rn — — = rvn . 
k=3 2A(l + PlJ ) 



Proof of formula (1531 ). For the function f(p) = J(t R ,p) — Ap/A from (EE 
we have 

f = 4t R (l + t R ) A f », t )<Q 

p+^(l + 2t R ) 2 p 2 -At R (l + t R ) 4' K " JJ 

Then for p > r R we have 

At R (l + t R ) A t r A 



r <r 



P=r R T R A 1~T R 4 

if ttj < ti(A), which proves the formula ( 1531) . ▲ 

Proof of lemma 1. Let {a?i, . . . ,Xm} C S' n_1 (v / An) be a code such that 
max(a3j, ac 3 -) < 0, i.e. min ||aCj — Xj\\ 2 > 2A. Then, clearly, M < 2n. 

In lemma 1 for all i we have (x i: y) = (A+r — s)n/2. Consider M vectors {x\ = Xi—ay}, 
where a = (A + r — s)/(2r). Then due to the condition (l48l) we have 

max [x'l, x'j ) < [AArp -(A + r- s) 2 ] n/(Ar) < , 



< 
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and therefore M <2n. A 

Proof of lemma 2. To prove lemma we reduce it to the case p ~ 0, and then 
use lemma 4 (see below). We set some integer m such that 1 < m < M, and introduce the 
vector 

m 

P 



a 



> Xk , a = — 

l + (m-l)p 



After simple calculations we get 



1 - 
p — 5 < ll z ll < P + <5 ) 

m 

P — 5 , p + 5 

< (xi,z) < - ■ — — r , z = m + l, ...,M. 



(73) 



1 + (1 - p)/(mp) ~ K u ' ~ 1 + (1 - p)/(mp) ' 
Consider the normalized vectors 

ajj — z 

w * = Ti ii> i = m+l,...,M. 

||aji - z|| 

Using the formulas ( l73l . for any i, j > m + 1, i ^ j, we get 

2 1 



K«i)<7ii; 5v 5+ mJ =o(1) ' n_>00 ' ( 74 ) 

if we set m — ► oo as n — > oo. To upperbound the maximal possible number M-m of 
vectors {u^} satisfying the condition (1741) . we use a modification of [TH Theorem 2]. 

Lemma 4. Zet C = {xi, . . . , a^} C S 11 ' 1 ^) be a code with (x iy Xj) < p, i ^ j. Then 
for n > 1 the upper bound holds 

M < 2n 3/2 (l - p)- n/2 , < p < 1 . (75) 

Proof. Denote p = cos(2<£>), and let M(ip) be the maximal cardinality of such a code. 
For M(<f) the upper bound holds [16, Theorem 2] 

(n — l)y/7rT ( — - — ) sin (3 tan/? 



2r(-J [sin"" 1 13- mn -2) cos/?] 4 
where (3 = arcsin(\/2 sin<y2) and 

/(/?, n - 2) = (n - 1) / sin™" 2 * . 



o 
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Integrating by parts, for the function f(/3,n — 2) we have 



m n-2) 



sin 



n-l 



sm 



n+l 







cos /3 



> 



sm 



n-l 



/3 



(n + 1) cos 3 /? (n + l 
sin n+1 /3 3tan 4 /3 



sin n+2 z 
cos 4 z 



dz > 



and therefore 



1 + 



cos P 

3 tan 4 (3 
n 2 — 1 



(n + 1) cos 3 /3 (n + l) 



<f{P,n-2)/ 



sm 



n-l 



cos P 



f(P,n-2) 



tan 2 /3 
n+l 



< 1 



if tan 2 /? < n + l, i.e. if 2sin 2 ^ < (n + l)/(n + 2). From (|ZS|) and fl77|) we get 

1 



M(v?) < 



n 



n 



1) cos /3 



since 



2r 



(z 2 



< 



sm 



n-l 







n^/ 7rn(l — 2 sin 2 </?) 
\/2 (\/2siny?) 



n-l 



r (|)<V2,3/ V a, 



2 > 0. 



(77) 



(78) 



From (1751 the inequality ( 1751 ) follows provided 2 sin 2 < (n+l)/(n+2), i.e. if u > l/(n+2). 
Since the function M((p) is continuous on the left for cp G (0, 7r], the upper bound (f78"j) 
remains valid for /x = l/(n + 2) as well. For /i = l/(n + 2), n > 1, the right-hand side of 
(1751) does not exceed n^Jire/2, which in turn does not exceed the right-hand side of (f75j) 
for any u > 0, n > 2. Since M(</?) is a decreasing function, it proves the inequality ( |75l) for 
any /i > 0, n > 2. Clearly, ( 1751) remains valid for n = 1 as well. ▲ 
Now from (1741 ) and ( l75i l we get lemma 2. A 

The author thanks L.A.Bassalygo, G.A.Kabatyansky and V.V.Prelov for useful 
discussions and constructive critical remarks. 
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Figure. Upper (15), (16) and lower (17) bounds for E(R, A) and A = 4 
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